Large deviation function for entropy production in driven one-dimensional systems 
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The large deviation function for entropy production is calculated for a particle driven along a 
periodic potential by solving a time-independent eigenvalue problem. In an intermediate force 
regime, the large deviation function shows pronounced deviations from a Gaussian behavior with 
a characteristic "kink" at zero entropy production. Such a feature can also be extracted from the 
analytical solution of the asymmetric random walk to which the driven particle can be mapped in 
a certain parameter range. 
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The mathematical theory of large deviations is con- 
cerned with the exponential decay of the probability 
of extreme events while the number of observations 
grows [l|. In driven systems coupled to a heat reservoir, 
energy in the form of heat is dissipated and therefore 
entropy in the surrounding medium is produced. The 
large deviation function of the entropy production rate 
in nonequilibrium steady states is a frequently studied 
quantity (see Ref. [|J and references therein) for basically 
two reason. First, since entropy is produced on average, 
the large deviation function captures the asymptotically 
time-independent behavior of the probability distribution 
for the entropy production. Second, the large deviation 
function exhibits a special symmetry called fluctuation 
theorem or Gallavotti-Cohen symmetry. First seen in 
computer simulations of a sheared liquid Q , the fluctua- 
tion theorem has been proven for both deterministic ther- 
mostated dynamics [IJH and stochastic dynamics [1, 0] • 

Analytical solutions for the large deviation function ex- 
ist only for a few simple models [1, H, H| - Obtaining the 
large deviation function over the full range from exper- 
imental data is a difficult task since trajectories leading 
to negative entropy production are strongly suppressed 
with increasing trajectory length (see, e.g., Ref. [HI). 
For a study of the complete large deviation function one 
therefore has to rely on computer simulations. To follow 
rare trajectories, different schemes have been proposed 
and implemented [ll|, [IH, 0]| . All these approaches have 
in common that they simulate trajectories from which 
the Legendre transform of the large deviation function 
is determined. In contrast, in this Communication we 
calculate numerically the Legendre transform directly as 
the lowest eigenvalue of an evolution operator. We there- 
fore reduce the problem of determining a time-dependent 
probability distribution to solving a time-independent 
eigenvalue problem. 

For a simple paradigmatic system, we investigate a 
single driven colloidal particle immersed in a fluid and 
trapped in a toroidal geometry by optical tweezers such 
that it effectively moves in one dimension [3, [l5| . For 
short and intermediate times, the experimentally mea- 
sured probability distribution for the entropy production 
exhibits a detailed structure with multiple peaks arising 
from the periodic nature of the system [l6| . As the ob- 



servation time increases, the distribution becomes more 
and more sharply peaked around its mean. Rare large de- 
viations from this mean are then governed by the large 
deviation function, which we determine in this study. We 
then compare our results in a certain parameter range to 
the analytically solvable model of the asymmetric ran- 
dom walk. 

The colloidal particle is driven into a nonequilibrium 
steady state through a constant force /. In addition, 
the particle moves within an external periodic potential 
V(tp), where ^ ip < 2ir is the angular coordinate of 
the particle. The total force acting on the particle is 
F(tp) — —d v V(tp) + f. The overdamped motion of the 
particle is governed by the Langevin equation 

dMt) = F&) + at). (i) 

The noise C represents the interactions of the particle 
with the fluid and has zero mean and short-ranged cor- 
relations (C(t)C(t')) = 28(t-t'). Throughout the paper, 
we set Boltzmann's constant to unity, leading to a dimen- 
sionless entropy. In addition, we scale time and energy 
such that the bare diffusion coefficient and the thermal 
energy become unity. 

We are interested in the large deviation function of the 
entropy production 

h(a) = lim lnp(s m ,i). (2) 

t— >oo t 

The entropy s m produced in the heat bath during the 
time t is a stochastic quantity with probability distribu- 
tion p(s m ,i). The asymptotic large fluctuations of s m 
are then given by p(s m ,t) ~ exp[— h{a)t], where a = 
(s m A)/(s m ) is the dimensionless, normalized entropy 
production rate. We will not determine the large devi- 
ation function h(a) directly through evaluating p(s m ,t) 
but from the generating function 

/+oo 
ds m e~ Xsm p(ip, s m ,t), (3) 
-oo 

Here, p(tp,s m ,t) is the joint probability for the particle 
to be at an angle tp and to have produced an amount s m 
of entropy during the time t. This generating function 
obeys the equation of motion dtg = L\g with an operator 
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L\ yet to be determined. We can then expand g into 
eigenf unctions tp n (ip,X) determined from the eigenvalue 
equation 

La ipn (<p, A) = -a n (X)ip n (tp,X). (4) 

The lowest eigenvalue ao(A) determines the asymp- 
totic time dependence of the generating function g ~ 
exp[— ao(X)i\. In particular, the mean entropy produc- 
tion rate is (s m ) = 0^(0). The large deviation function 
finally is the Legendre transform 

h(a) = a (A*) - (s m )<j\*, (s m )a = a' (X*) (5) 

of the cumulant generating function as can be shown by 
a saddle-point integration. The large deviation function 
for the entropy production shows the symmetry relation 

h(-<i) = h(a) + (s m )a (6) 

called fluctuation theorem 0,0, If the fluctuation the- 
orem holds then the lowest eigenvalue exhibits an equiv- 
alent symmetry, ao(A) = ao(l — A). Hence, it is a sym- 
metric function centered at A = 1/2 @. 

In this approach, the asymptotic fluctuations of s m can 
be extracted from the solution of the eigenvalue equa- 
tion |4} for n — 0. As an advantage compared to fol- 
lowing definition @, we do not have to solve a time- 
dependent equation of motion for p(s m ,t). Instead, the 
information of the asymptotic fluctuations is contained in 
a time-independent equation which we can tackle more 
easily. 

The entropy change along a single stochastic trajectory 
is defined as the functional [ljj 

s m [x(r)} = [ dr F{x{t))x(t) = f(x - x ) - AV. 
Jo 

The time integration implies the introduction of a second 
angular coordinate x which takes into account the num- 
ber of revolutions of the particle and measures the total 
traveled distance in contrast to the bounded coordinate 
(p. Since the terms involving AV and xq are bounded 
they will not contribute to the entropy production rate 
in the limit of large times. Hence, the expression for the 
entropy production in this limit simplifies to s m ~ fx. 

The Fokker-Planck operator corresponding to the 
Langevin equation (TJJ reads 

L = -d v {F-d v ). (7) 

In the next step, we want to obtain the evolution operator 
L for the joint probability p(ip, s m ,t) which obeys dtp = 
hp. This operator is then converted to the sought-after 
evolution operator L\ for the generating function ([3]). 
The stochastic processes for cp and x (and hence s m ) share 
the same noise. We can therefore replace d v i— > (cL + d x ) 
to obtain 

L = L + {2d v - F)d x + dl (8) 



Differentiating Eq. ([3]) with respect to time and inserting 
the operator ([5]) leads after partial integration to 

L A = L + [2d v - F)fX + (/A) 2 (9) 

with vanishing boundary terms. 

For the numerical evaluation, we represent the op- 
erator L\ as a matrix through choosing a basis. To 
this end, we distinguish left sided (k\ from right sided 
\k) basis states. The basis must be complete and or- 
thonormal, (k\l) — S^i- Expanding the eigenfunctions 
ipn(X) = J2k c fc^(A)|fc) m to the basis, Eq. ([4]) becomes 

oo 

Y, L kl c\ n) = -a„(A)4 n) , L kl = (k\L x l). (10) 

/— — oo 

Hence, we seek the lowest eigenvalue ao(A) of the matrix 
L> = (Lki) where A appears as a mere parameter. A 
suitable choice for the basis is 

(%) = —, fo,| fc >= dH^| = i 

v ~" (ii) 

due to the periodic nature of the system. 

We now specialize our analysis to a cosine potential 
V((p) — vq cos (p introducing a second dimensionless pa- 
rameter vo- A straightforward calculation shows that the 
matrix La becomes tridiagonal with elements 

L kk = -(k-if\) 2 -if(k-if\), 

Lfc,k±i = ±y (k - i/A). 

We are not aware of an analytic solution for the eigen- 
values of such a matrix. However, by truncating the size 
of the matrix to some finite value, they can easily be 
found numerically by standard algorithms. In Fig. [TJ we 
show both ao(A) and the large deviation function h(a) 
of the entropy production. The fluctuation theorem ([6]) 
is fulfilled as can be seen immediately by the symmetry 
of ao(A). For large driving forces / > do as depicted 
in the right panels, both functions are almost parabolic. 
In this case, the particle hardly "feels" the potential and 
the mean velocity becomes (x) ~ f. Integrating over the 
angle tp, the eigenvalue can then be read off from the 
operator © as 

Q o(A) = (s m )A(l — A), %) = ((s m )/4)(a-l) 2 (12) 

with (s m ) w f 2 . For small forces / <C vq (left panels), 
the particle remains mostly within one potential mini- 
mum and the mean rate becomes exponentially small in 
the barrier height 2vq. In this case, the large deviation 
function again approaches a parabola for which the sym- 
metry (JB]) enforces the same functional form (|12[) as in 
the large force regime. The analytical functions (Tj"2")) are 
shown together with the numerical curves for both small 
and large forces in Fig. [TJ 

Deviations from the simple Gaussian behavior show 
up in the right panels of Fig. [JJ even for surprisingly large 
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FIG. 1: Eigenvalue ao(X) (top row) and large deviation function h(a) (bottom row) for the entropy production versus the 
force values / = 0.05 (left), / = 4.05 (center), and / = 100 (right) for a potential depth vo = 5. The ordinates are in units 
of the mean production rate (s m ). For small and large forces, the large deviation function and therefore the eigenvalues are 
almost parabolic. The corresponding analytical functions (|12p are shown for comparison. The insets in the right panels show 
the enlarged regions around A = 1/2 and a = 0, respectively. 



forces. The eigenvalue exhibits a flattening compared to 
the analytical curve around its center A = 1/2. This fea- 
ture becomes more pronounced in the intermediate force 
regime / ~ vo (center panels). For the cosine potential 
fc — v o corresponds to the critical force f c , for which 
the barrier vanishes and deterministic running solution 
for cp(t) set in. In the large deviation function h(a), this 
flattening corresponds to a "kink" , an abrupt albeit dif- 
fer cntiable change around a = 0. For an explanation 
of the physical origin of this phenomenon note that all 
trajectories along which s m grows slower than linearly in 
time are mapped onto a = 0. If for a large number of 
trajectories s m grows sublinearly, i.e., if a = has a high 
probability density then h(0) becomes small. Due to the 
fluctuation theorem (jHJ) and Eq. ((SJ), arj(l/2) = h(Q) al- 
ways holds. Since the slope a' (0) = c/ (l) = (s m ) at 
A = and A = 1 is fixed by the mean entropy pro- 
duction rate, for small ao(l/2), i.e., for small h(0) the 
concave curve ao(A) must become flat. In Fig. [21 the 
ratio (s m )/h(0) is plotted together with the force curve 
/ max (i>o) for which (s m )/h(0) becomes maximal for fixed 
vq. This curve indicating the strongest "kink" is of the 
order of the critical force / c = vq. Hence, it seems that 
in this force regime the particle disproportionately often 
stays at or departs sublinearly from its initial position. 

A similar "kink" in the large deviation function around 
(7 = can be observed for the analytically solvable asym- 
metric random walk. The asymmetric random walk is 
described by two rates k + and k~ for a step forward and 
backward, respectively. The entropy produced or anni- 
hilated in a single jump is b = \n(k + /k~) [Tt], Ha |. The 
random walker jumps n + steps forward and n~ steps 
backward. The probability to have traveled n = n + — n~ 
steps in the forward direction during a time t is known 



analytically jl9j ], 

p(n,t) = I n (2Vk+lFt){k + /fc-)"/ 2 e -( fc++fe ~)*, (13) 

where I n (z) is the modified Bessel function of the first 
kind of order n. For the entropy production s m = bn, 
the generating function (J3]) becomes 



7(A,t)= £ 



-Xbn 



p{n,t) 



£ I n (z) ^WJk=er>- 



n— — oo 



maximum 
critical force 




FIG. 2: The ratio (s m ) /h(0) as a two dimensional contour plot 
for the parameters / and vo- The straight line is the critical 
force / = vo. The thick line indicates the maximal value, i.e., 
it indicates the parameter pair for which the "kink" at a = 
in Fig. [TJ becomes the most pronounced. 
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FIG. 3: Comparison between the large deviation functions 
h(a) of the continuous dynamics and the asymmetric random 
walk (ARW). The parameters are: (left) vq = 5 and / = 0.05, 
(center) vo = 13 and / = 1, (right) vo = 5 and / = 4.05. 



The sum can be evaluated using [201 ] 

oo 

]T /^K-exp^^c + c- 1 )] 



We thus obtain an exponentially decaying generating 
function g(\,t) — exp[— ao(A)t] with the single eigen- 
value 



a (A) = k+ 



1 



-6 -Ah -(l-A)o 

e — e — e y ' 



(14) 



obeying the symmetry ao(A) = ao(l — A) as expected [23 ]. 
The curvature of the large deviation function h(a) at 
(j = can now be obtained analytically as 



oft (1/2) 



^_ e -(3/2)6 , 
2 



(15) 



For fixed forward rate k + , this expression diverges for 
— * (6 — ► oo), i.e., for vanishing backward steps. 
In a parameter regime where the dynamics of the 
driven colloidal particle is dominated by hopping events 
from one potential minimum to another, i.e., for f < v , 



we can map the driven particle to the discrete asymmet- 
ric random walk. The escape rate k + can be obtained by 
specializing the general Kramers expression [21,] as 



k + = ^-xexp{-2v [x 

Z7T 



(7r/2)a + aarcsina]} (16) 



with x = vl — a, 2 depending on the two parameters Vq 
and the ratio a = f /vq. In Fig. [3J we compare the large 
deviation functions of the continuous dynamics and the 
mapping to the corresponding asymmetric random walk 
for three different parameter sets vq and /. For small 
forces (left panel), the function h(a) is a parabola as it 
should be in such a linear response regime. Excellent 
agreement between the two models is also obtained for 
deep potentials and larger forces (center panel) for which 
h(a) significantly deviates from a parabola but still shows 
no "kink" at a = 0. Finally, in the right panel for / ap- 
proaching the critical force, the mapping to the Kramers 
model breaks down as expected. Still, both curves show 
a "kink" in this regime. 

In summary, we have determined for a driven colloidal 
particle the large deviation function of the entropy pro- 
duction by calculating the lowest eigenvalue of the oper- 
ator (|9|) . We have used a numerical approach to directly 
calculate the eigenvalue without simulating trajectories. 
This approach can be extended to more complex systems 
with more than one degree of freedom through choosing 
an appropriate basis. We have further compared our re- 
sults for a certain parameter range with a model where 
the large deviation function and the eigenvalue can be 
obtained analytically. In both cases, the large deviation 
function develops a "kink" , an abrupt change around zero 
entropy production. The question remains whether and 
to which extent this kink will be a general feature also 
present in interacting systems. 
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